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ABSTRACT 

While the importance of effective principals is undisputed, few studies have addressed what 
specific skills principals need to promote school success. This study draws on unique data 
combining survey responses from principals, assistant principals, teachers and parents with rich 
administrative data to identify which principal skills matter most for school outcomes. Factor 
analysis of a 42-item task inventory distinguishes five skill categories, yet only one of them, the 
principals’ organization management skills, consistently predicts student achievement growth 
and other success measures. Analysis of evaluations of principals by assistant principals 
confirms this central result. Our analysis argues for a broad view of instructional leadership that 
includes general organizational management skills as a key complement to the work of 
supporting curriculum and instruction. 
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INTRODUCTION 



There is little doubt that school leaders matter for school success. A large number of studies 
spanning the last three decades link high quality leadership with positive school outcomes, 
including student achievement (Hallinger and Heck, 1998; Waters, Marzano, and McNulty, 

2003; Andrews and Soder, 1987; Cheng, 1991; Brewer, 1993; Leithwood, Jantzi, Silins, and 
Dart, 1993; Leithwood, 1994; Goldring and Pasternak, 1994). This recognition of the importance 
of principals has led to increased policy attention to attracting and preparing school leaders 
(Davis, Darling-Hammond, LaPointe, and Meyerson, 2005; Hale and Moorman, 2003). 
Unfortunately, existing research does not tell us enough about the policies state and district 
leaders can adopt to recruit and prepare effective principals. This study is a step in that direction, 
articulating the range of skills needed for principals to perform their job effectively. The paper 
also describes differences across principals and schools in principal efficacy in these domains. 
Furthermore, the paper provides systematic evidence of the linkages between school leader 
efficacy and school outcomes, including student achievement gains and teacher satisfaction. 

There have been two major obstacles to research identifying important skills for 
principals: data availability and the complexity of principals’ work. Data suitable for doing 
rigorous empirical work in this area are scarce. Without long-run longitudinal data it is difficult 
statistically to separate the effect of a principal from the effect of the school as a whole. This 
difficulty is important if we want to attribute a change in school outcomes to a specific principal 
versus a previous principal, or other aspects of the school such as student-body composition. The 
problem is complicated by the fact that school principals influence student outcomes indirectly 
through, for example, decisions they make in teacher hiring or through policies making schools 
safe and orderly (Hallinger and Heck, 1998; Witziers, Bosker, and Kruger, 2003). Without 
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access to detailed data on behaviors and outcomes along these pathways, it is difficult to 
distinguish the principal’s effect (Hallinger, Bickman, and Davis, 1996). Even when a statistical 
link between particular principals and student outcomes can be identified, an inability to find 
principal practices or intermediate outcomes that would illuminate the pathway by which the 
principals affected school outcomes limits the relevance of the result. 

The other obstacle to developing a body of useful empirical work on principal 
effectiveness is the wide range of possible dimensions over which to describe principals and 
what they do. Much of the research on principal effectiveness focuses on measures of principals' 
dispositions and feelings of overall effectiveness. As one example, in a study of 96 principals, 
Leithwood and Jantzi (2008) find that the school leadership’s sense of collective self-efficacy 
positively predicts the schools’ achievement levels. Other studies emphasize leadership styles or 
orientations, as with the large body of work on instructional leadership and transformational 
leadership, for example (e.g., Marks and Printy, 2003). 

In contrast, this paper focuses on the identification of specific sets of principal skills that 
are associated with positive school outcomes, where outcomes are measured in multiple ways 
from multiple perspectives. Drawing on comprehensive survey and administrative data from one 
large urban district, we use a newly developed task index for principals and their own self- 
assessments of their effectiveness in each of these tasks to define areas of relative strengths, 
describe how those strengths vary by principal and school contexts, and test the degree to which 
principals’ relative competencies in these areas predict school outcomes. In so doing, we seek 
both to expand the study of school administration in new directions and to contribute to the base 
of empirical research in this area, a need prominent scholars in the field recently have 
highlighted (e.g., Hallinger and Heck, 1998). 
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The study addresses five main research questions. First, we ask how principal task 
efficacy varies across tasks. That is, are there particular tasks for which principals feel especially 
equipped or ill-equipped? Second, we ask the extent to which efficacy on individual tasks can be 
grouped into larger dimensions of self-assessed effectiveness. Next, we ask whether task efficacy 
varies systematically across principal and school characteristics. Fourth, we ask how principal 
task efficacy predicts key school outcomes, including student achievement gains, teacher 
satisfaction, and parents’ assessments of school performance. Finally, as a check on the validity 
of the results, we ask how assistant principals’ assessments of their principals’ task effectiveness 
compare to the principals’ self-assessments and, furthermore, whether the assistant principals’ 
assessments similarly predict school outcomes. 

This paper proceeds as follows. The first two sections describe the prior research on 
principal effectiveness and the data and methods used in this study. The remainder of the paper 
addresses each of our research questions: describing principals' assessments of their effectiveness 
across tasks; identifying dimensions of principal task effectiveness; analyzing differences by 
school and principal characteristics; and linking task-efficacy to school outcomes. The 
penultimate section reexamines principal task effectiveness using ratings of the principals’ skills 
provided by assistant principals in the same schools. The paper concludes with a discussion of 
the implications of the results, limitations of our approach, and directions for future work in this 
area. 
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PRIOR RESEARCH ON PRINCIPAL EFFECTIVENESS 



Our study extends a long literature on the role of the principal in influencing school performance. 
Prior research suggests this influence can be substantial. In a meta-analysis of 70 empirical 
studies from this body of work, Waters, Marzano, and McNulty (2003) find the average effect 
size of school leadership, broadly defined, on student achievement to be approximately 0.25. The 
effects in the studies they reviewed operated via a variety of mechanisms, including building a 
sense of community, establishing school routines, providing teachers with necessary resources, 
and advocating for the school to stakeholders. Leithwood, Louis, Anderson, and Wahlstrom 
(2004) and Hallinger (2005) similarly conduct reviews of the literature on how school leadership 
impacts student achievement and conclude that leaders tend to impact student learning through 
their influence on school staff and structures. 

The questions of what makes principals effective and which principal behaviors are most 
consistent with school improvement have sparked substantial scholarly inquiry in recent decades, 
with two approaches to principal leadership emerging as most dominant in the literature: 
instructional leadership and transformational leadership. Instructional leadership theory tends to 
focus on the principal’s role in framing the school’s mission, coordinating and monitoring the 
school’s instructional program, and developing a positive learning culture (Hallinger and 
Murphy, 1985). In contrast, transformational leadership theory (Bass, 1998; Bums, 1978) 
emphasizes collaboration with other stakeholders, particularly the role of the principal in 
inspiring and motivating the staff, developing a commitment to a common vision, building the 
staff’s capacity to work collaboratively, and shaping the organizational culture. In a recent meta- 
analysis, Robinson, Lloyd, and Rowe (2008) use the results of 22 studies of these two 
approaches to compare the effects of instructional and transformational leadership on student 
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outcomes. They estimate that the average effect of instructional leadership on student outcomes 
is three to four times greater than the effect of transformational leadership. In a second analysis, 
the authors analyze survey items from 12 of the studies and inductively identify five leadership 
dimensions: (1) establishing goals and expectations; (2) resourcing strategically; (3) planning, 
coordinating, and evaluating teaching and the curriculum; (4) promoting and participating in 
teacher learning and development; and (5) ensuring an orderly and supportive environment. They 
find the strongest effects on student outcomes from dimension (4), followed by dimensions (1) 
and (3). Combining the findings from the two analyses, the study concludes that “the more 
leaders focus their relationships, their work, and their learning on the core business of teaching 
and learning, the greater their influence on student outcomes” (636). 

This emphasis on the teaching and learning aspects of school leadership is characteristic 
of the instructional leadership literature. This research generally concludes that a strong, 
directive principal, focused on curriculum and instruction, is essential for effective schools (e.g., 
Blase and Blase, 1992; Heck, 1992; Leithwood, 1994; Southworth, 2002). Strong instructional 
leaders are described as hands-on with curriculum and instruction issues, unafraid to work 
directly with teachers, and present often in classrooms. While the focus on instructional 
leadership waned somewhat in the 1990s as transformational leadership received greater research 
attention, interest in instructional leadership in the literature has been invigorated by the 
accountability and school improvement movements, which have re-emphasized the role of the 
principal in facilitating instructional quality (Hallinger, 2005). Scholars also have argued for 
other approaches, such as Marks and Printy’s (2003) “integrated leadership” approach, which 
combines instructional and transformational leadership. This research concludes that the most 
effective schools are the ones in which the two models coexist. 
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The present study departs from this emphasis on leadership orientations and beliefs to 
focus on principals’ actions and behaviors. A comparison of items typically used to measure 
instructional and transformational leadership, taken from Marks and Printy (2003), to our items 
illustrates this difference. For example, Marks and Printy ’s measures of instructional leadership 
include ratings of the degree to which teachers influence curriculum choices and principals 
influence instruction, while their measures of transformational leadership include survey 
responses to such statements as “The principal shares power with teachers,” and “The school 
administration’s behavior toward the staff is supportive and encouraging.” In contrast, we 
evaluate task efficacy, asking principals and assistant principals to evaluate principal 
effectiveness in such task areas as “planning professional development for teachers,” 
“communicating with parents,” and “managing school schedules.” 

Our study draws on substantial prior research on the impact of leader traits or skills on 
organizational outcomes, both inside and outside the education literature. For example, 
Marcoulides, Larsen, and Heck (1995) test a structural model of instructional leadership using 
data on 21 tasks from 140 principals in Texas with the goal of developing an instrument for 
evaluating principal performance, though they do not test whether their model predicts external 
outcomes. Heck (1992) links data from principals and teachers to school performance using 
ratings of principals’ performance in three domains: governance, developing the school climate, 
and organizing the school’s instructional program. He finds that some principal behaviors, such 
as making frequent classroom visits, are more predictive of school achievement than others. In 
the higher education context, Heck, Johnsrud, and Rosser (2000) gather assessments from faculty 
and staff to evaluate the performance of six college deans and directors, but their focus is on 
improving measurement rather than on tying assessments to outputs. In another study, the 
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authors expand their analysis to 22 deans and estimate a structural model that links instrument- 
based effectiveness ratings to personal and organizational characteristics, such as the dean’s 
gender or the size of the college the dean supervises (Rosser, Johnsrud, and Heck, 2003). 

Using an approach most similar to the one employed in this study, Porter, Goldring, 
Murphy, Elliott, and Cravens (2006) develop the Vanderbilt Assessment of Leadership in 
Education (VAL-ED) to assess the effectiveness of specific educational leadership behaviors, 
using self-ratings by principals as well as ratings by supervisors and teachers in their schools. 

The leadership behaviors assessed in their instrument lie at the intersection of core components 
of school performance (i.e., what leadership must do to improve school outcomes) and key 
processes of leadership (i.e., how leadership develops these core components). While these 
researchers identified behaviors from prior studies of effective principals, they have yet to 
explicitly link results from the VAL-ED assessment to increased school performance. 

Recent studies in the private sector make use of a similar assessment strategy to examine 
the impact of organizational leaders on outcomes. For example, Bloom and Van Reenen (2007) 
use cross-national interview and survey data to measure management practices of plant managers 
in a variety of firms. They find that more highly-rated organizational management practices are 
associated with long-run firm sales and profitability. Kaplan, Klebanov and Sorensen (2008) use 
detailed data from tests given to candidates for top CEO positions in private equity investment 
firms by an outside assessment firm to link job skills to hiring and firm performance. In results 
congruent with the ones we present below, they find that CEO success is linked more closely to 
what they label “execution capabilities” than capabilities related to team-building and interacting 
with others. Building upon this previous research, the next section describes how we examine the 
associations among specific leadership skills and school outcomes. 
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DATA AND METHODS 



Data for this study come primarily from Miami-Dade County Public Schools (M-DCPS). With 
approximately 350,000 students, M-DCPS is the fourth-large st school district in the United 
States. It is also a diverse district, with approximately nine percent white students, 26 percent 
black students, and 63 percent Hispanic students. More than 60 percent of students are eligible 
for the Free or Reduced Price Lunch program and 15 percent are classified as English language 
learners. The district is organized more hierarchically than the typical district; leadership is 
divided into three tiers across nearly 400 schools, six regional centers that oversee such areas as 
curriculum and professional development, 1 and a central district office. The data we collected 
focus on the school level and include one-time surveys of principals, assistant principals and 
teachers. To these survey data we link district administrative data on schools, staff, and students, 
as well as data from school district climate surveys and state data on school performance. We 
use these data to create measures of: 

• Principals’ self-assessed effectiveness at job tasks 

• Assistant principals’ assessment of their principal’s effectiveness at job tasks 

• Teachers’ satisfaction levels 

• Parents’ assessment of the schools’ effectiveness 

• Student achievement levels and gains over time 

• Characteristics of principals, assistant principals, teachers, and schools 

Survey Data 

Our measures of principal self-assessment come from an online survey of principals given to 314 
M-DCPS principals in the district in the spring of 2008. The survey yielded a response rate of 89 
percent. As part of the survey, principals were presented with 42 job tasks common to the 

1 The number of regional centers was reduced from six to four after the data for this study were collected. 
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principalship and asked to rate how effective they felt they were at conducting each task in their 
current school. To develop this list of tasks, we began with the broad categories of principal 
duties described by Spillane, Camburn, and Pareja (2007) but added substantially more 
specificity to the task list. We developed this specificity through consultation with principals in 
multiple states and through discussions with participating district leadership. Our expanded list 
was subsequently refined through pilot shadowing of principals in local schools. A four-point 
response scale was used ( ineffective , a little effective, effective , and very effective). 

We administered a similar survey to assistant principals in the district at the same time as 
the principal survey (n = 585). The response rate was 85 percent. The assistant principal survey 
included the same 42-item task inventory and asked the respondent to assess how effective his or 
her principal was at completing each of the tasks. 

In conjunction with the surveys of principals and assistant principals, we conducted a 
survey of all 15,842 teachers in the district that yielded responses from 83 percent. In this paper, 
we use the responses of the teachers to the following question: “To what extent are you 
generally satisfied with being a teacher in this school?” The possible answers were dissatisfied, 
somewhat dissatisfied, somewhat satisfied , and very satisfied. 

Unfortunately, we were not able to conduct a survey of parents as part of this study. 
However, the district provided us with access to data from a parent climate survey that the 
district conducts each year. On this survey the parents respond to the following question: 
“Students get grades A, B, C, D, and F for the quality of their school work. What overall grade 
would you give your child’s school?” We used the average grade that parents report as a 
measure of their assessment of the school. 
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Administrative Data 



We merge our survey data with administrative data provided by the district. This data include 
school performance data based on Florida’s A+ accountability system. Florida grades each 
school on a five point scale (A, B, C, D, F) that is meant to capture aggregated performance of 
the organization across grades and schools in a succinct fashion that is consistent across levels of 
schooling and easily understood by parents and policymakers. Grades are based on a scoring 
system that assigns points to schools for their percentages of students who achieve the highest 
achievement levels in reading, math, science, and writing on Florida’s standardized tests in 
grades 3 through 10, or who make gains in achievement level. Grades also take into account the 
percentage of eligible students who are tested and the math and reading gains of the lowest- 
performing students. A more extensive description is available in Figlio and Lucas (2004). We 
use the data for the 2007-08 year, which is the year of our surveys. We also use school grades 
for previous years as controls and to capture changes in school performance over time. 

A+ grades admittedly are an imprecise measure of school performance. Nonetheless, they 
have been utilized in a variety of studies of Florida’s public schools. These studies have 
examined the relationships between school grades and such variables as school instructional 
focus (Goldhaber and Hannaway, 2004), school policies (Rouse, Hannaway, Goldhaber, and 
Figlio, 2007), and housing prices (Figlio and Lucas, 2004). Because of the imprecision in a 
school’s accountability grade, it is important that grades are but one outcome measure examined. 

The administrative data also provide information that allows us to account for factors that 
might affect principals' assessment of themselves or assistant principals' assessments of their 
principal, or that might be correlated with teacher satisfaction, parents’ ratings of the school, or 
school grades. This information includes school characteristics such as grade level, poverty 
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concentration of students and racial concentration of students. For teachers, assistant principals 
and principals we also utilize measures of experience, gender, race and ethnicity, age, and 
whether they hold a Master’s or higher degree. 

Descriptive Statistics 

Table 1 gives the means and standard deviations of all variables used in the analyses, with the 
exception of principal and assistant principal ratings, which we describe in more detail below. 
The 244 schools in our sample on average serve 33 percent black students and 68 percent 
students eligible for subsidized lunch. Approximately 60 percent of schools are elementary 
schools, with another 20 percent middle schools and 15 percent high schools. Sixty-nine percent 
of the principals in the sample are female; 33 percent, black; and 61 percent, Hispanic. 
Principals, who, on average, are 50 years old, have only been in their current school for an 
average of about three years. Assistant principals (not shown in the table) look similar by race, 
gender, and years in their current position to principals but are a bit younger, at 44 years. 
Teachers in the sample are 78 percent female, 25 percent black and 54 percent Hispanic, having 
served just over five years in their current job, on average. 

Table 1 also describes our three outcome variables: school accountability grades, teacher 
satisfaction, and parental assessment of the school. School grades range from one (F) to five (A) 
and average almost a four (B). Teacher satisfaction ranges from one to four with a high average 
of 3.3. School grades from parents are on a one to eight scale (C-, C, C+, B-, B, B+, A-, A); 
though grades of F, D-, D, D+, and A+ were also options, none of the schools received these as 
their mean parent ratings. On average, parents graded schools at 5.6, approximately a B+. 
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Methods 



This paper asks five questions. The first three ( How does principal task efficacy vary across 
tasks? What are the dimensions of principal task efficacy? How does principal task efficacy 
systematically vary across principals and schools?) are descriptive. To begin, we simply 
describe the means and standard deviations of principals’ assessment of their own effectiveness 
on each of the 42 tasks. We then employ exploratory factor analysis with varimax rotation on 
these assessments to identify our task effectiveness dimensions. We compare the self-assessed 
task effectiveness across principals with different characteristics and across schools with 
different characteristics using simple t-tests. 

The remaining research questions ( How does principal task efficacy predict other school 
outcomes including student performance, teacher satisfaction, and parental assessment of the 
school? How do assistant principals ’ assessment of principals ’ task effectiveness compare with 
principals ’ assessments and school outcomes ?) require more sophisticated analyses. We estimate 
each school outcome as a function of principal effectiveness along each of the five tasks 
dimensions that we identify in the factor analysis. Using standard ordinary least squares 
regression, we control for other school characteristics, including student poverty and race 
composition and school level. We run specifications including and excluding school 
performance grades (prior grades when current grades are the outcome and current grades for 
teacher satisfaction and parental assessment of the school). The models for school grades and 
parental satisfaction are at the school level. For the models in which teacher satisfaction is the 
outcome variable, we run teacher-level analyses, controlling for teacher characteristics and 
accounting for the grouping of teachers within schools by clustering standard errors at the school 
level. 
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The final analysis uses data from the surveys of assistant principals, which include 
assessments of the principal on each of the same 42 dimensions. Because assistant principals do 
not necessarily observe the principal on all the tasks, we allow the data to identify new 
dimensions of assistant principal-assessed principal effectiveness using factor analysis. We then 
use regression analysis similar to that described above to assess the relationship between these 
task-effectiveness dimensions and student performance, teacher satisfaction, and parent 
assessment of the school. 

An important contribution of this study is the delineation of five skill areas that 
categorize principals’ task effectiveness. The next section details the analysis that leads to the 
identification of these five areas. 

DIMENSIONS OF PRINCIPAL TASK EFFECTIVENESS 

To better understand the job of the principal, we developed a list of common tasks that principals 
are likely to encounter regularly as part of their job duties. As described above, this task list 
drew from the research literature, discussions with principals, and observations in pilot schools. 
We then converted this list into an inventory of 42 task items and asked principals to rate their 
own effectiveness at each one on a four-point scale. Example items included “Hiring personnel,” 
“Maintaining campus facilities,” “Evaluating curriculum,” and “Communicating with parents.” 
Figure 1 shows the items. 

An exploratory factor analysis of principals’ responses identified patterns in the 
effectiveness ratings.” Bartlett’s sphericity test (p < 0.001) and the Kaiser-Meyer-Olkin statistic 
(0.921) both confirmed the adequacy of the data for factoring. With the standard criterion of 
accepting factors with eigenvalues greater than 1.0, five underlying factors emerged from the 
2 A small number of item responses were imputed prior to factoring to avoid loss of sample size. 
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data. To aid in the identification of patterns of loadings across factors, we used varimax rotation. 
One consequence of this rotation is that the rotated factors are uncorrelated with one another by 
construction, a fact that affects how we interpret the results later on. At this stage, two of the 42 
items were dropped because the loadings were very low across all five factors. Among the 
remaining 40 items, we identified and labeled five distinct dimensions along which principals 
judge their own effectiveness using the factor loadings matrix shown in Appendix Table 1. We 
denote these dimensions of principal skills as: Instruction Management , Internal Relations, 
Organization Management , Administration, and External Relations. Below we describe each 
dimension. 

Figure 1 groups the individual items under these headers according to which factor each 
elemental variable loaded on most heavily. The figure shows variation in principals’ ratings 
across individual items within and across the factors. On average, principals felt the most 
effective at developing relationships with students, communicating with parents, attending 
school activities, developing safe school environments, dealing with concerns from staffs, 
managing school schedules and using data to inform instruction. Principals felt least effective at 
fundraising, planning professional development for prospective principals, releasing or 
counseling out teachers, utilizing district office communications to enhance their goals, and 
working with local community members and organizations. While on average principals rated 
themselves highly on most tasks, we will see below that there is sufficient variation in the 
composite factor scores to identify differences across principals in their relative ratings across 
factors. 
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Instruction Management 

The Instruction Management dimension represents the set of tasks in which principals engage in 
order to promote, support and improve the implementation of curricular programs in classrooms. 
As shown in Figure 1, 13 items from the principal questionnaire primarily load onto this factor. 
Three of the items with the highest loadings are those that address the role of the principal in 
developing teachers’ instructional capacities: planning professional development for teachers 
(0.72), implementing professional development (0.66) and informally coaching teachers (0.62). 
The next three items that rank most highly involve the evaluative role the principal plays with 
respect to classroom instruction: evaluating curriculum (0.62), using assessment results for 
program evaluation (0.62) and formally evaluating instruction and providing instructional 
feedback (0.60). Professional development and program evaluation clearly anchor principals’ 
assessments of their effectiveness as managers of school instruction. 

How effective do principals rate themselves with respect to the various Instruction 
Management measures? Figure 1 is organized to facilitate ease of comparison among items, 
ordering them from highest to lowest within factors. One general observation from scanning 
across all of the factors is the relative lack of variation; mean responses for all but one item 
(fundraising) fall above 3.0, which corresponds to “effective” on the ratings scale. In other 
words, principals as a group generally expressed confidence in their abilities to engage in and 
complete nearly all the tasks about which they were asked. Within the Instruction Management 
factor, less than half a rating point separated the task at which principals felt most effective 
(using data to inform instruction, 3.64) from the one at which they felt least effective (planning 
professional development for prospective principals, 3.18). Yet while few principals rated 
themselves “ineffective” or only “somewhat effective” across the tasks assessed by the survey, 
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there was more variation between those who rated themselves “effective” and those who rated 



themselves “very effective.” Thus while 65 percent gave themselves the highest score on using 
data to inform instruction, just 35 percent gave themselves a similar rating for their ability to 
plan professional development for potential principals. 

Taking a self-assessment of four as an indication that a principal feels completely 
confident in his or her ability to complete a given task effectively, we find that in six of the 13 
tasks measured under Instruction Management, at least half of responding principals feel fully 
effective. In addition to data use, these are: developing a coherent educational program across the 
school (61 percent), using assessment results for program evaluation (60 percent), formally 
evaluating teachers and providing instructional feedback (57 percent), classroom observations 
(57 percent), and utilizing school meetings to enhance school goals (56 percent). At the other end 
of the spectrum, just 38 percent of principals expressed full confidence in their effectiveness at 
directing supplementary instruction, and just 31 percent felt fully effective at releasing or 
counseling out ineffective teachers. 

Internal Relations 

The second dimension of principal task effectiveness we label Internal Relations. This factor 
captures effectiveness at tasks related to principals’ capacities for building strong interpersonal 
relationships within the school. Seven of the task items load most highly onto this factor. The 
items that load most highly are counseling staff about conflicts with other staff members (loading 
= 0.68) and counseling students or parents (0.66). 

Figure 1 shows that there is even less variation in principals’ ratings of their effectiveness 
at building interpersonal relationships than we saw with Instruction Management. The mean 
score for six of the seven items was 3.5 or higher, and the seventh, interacting socially with staff, 
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had an average of 3.42. On each of these items, at least half of principals gave themselves the 
highest score of four, indicating that in general principals feel a high degree of confidence in 
their effectiveness in the interpersonal dimension. Seventy-two percent of principals rated 
themselves “very effective” at developing relationships with students, and 70 percent said they 
were “very effective” at communicating with parents. At the other end of the spectrum, just 54 
percent gave themselves the highest ratings on informally talking to teachers about students, and 
just over 50 percent felt fully effective at interacting socially with staff. 

Organization Management 

A third identifiable set of tasks captured the principal’s effectiveness at overseeing the 
functioning of the school. This set included tasks that we would expect the principal to take 
active and direct responsibility for executing throughout the year in pursuit of the school’s 
medium- and long-term goals. We refer to this dimension as Organization Management. The 
three (of eight) questionnaire items that load most highly onto this factor are maintaining campus 
facilities (loading = 0.65), managing budgets and resources (0.59), and developing a safe school 
environment (0.55). 

Again, the mean self-ratings for the Organization Management tasks were quite high on 
the whole, with seven of eight receiving a mean score of 3.5 or higher. Looking instead at the 
variation between scores of three and four, we see that principals rated themselves most effective 
at developing a safe school environment (“very effective” = 68 percent), dealing with concerns 
from staff (65 percent) and managing the budget (64 percent). The lowest scores were given to 
networking with other principals (47 percent), an item that in fact does not load highly on any of 
the five factors. Exempting this item, no fewer than 53 percent of principals indicated the highest 
level of effectiveness at any of the tasks in the Organization Management dimension. 



17 




Administration 



We label the fourth dimension of principal task effectiveness Administration . Again, eight 
questionnaire items capture this construct. This area of task effectiveness is characterized by 
more routine administrative duties and tasks executed to comply with state or federal regulations. 
The two items that load most highly on this factor are managing student records and reporting 
and implementing standardized tests, both of which have loadings of 0.60. Other tasks in this 
area include managing school schedules, fulfilling compliance requirements and paperwork, and 
managing student attendance-related activities. Administration also includes student discipline 
and student supervision (e.g. lunch duty). 

In this area, principals report feeling most effective at managing school schedules and 
managing student discipline. Both of these items had means of about 3.65 with approximately 
two-thirds of principals assessing their effectiveness at the highest level on the scale. Fulfilling 
compliance requirements and implementing standardized tests are also tasks at which principals 
tend to rate themselves highly, with 60 and 5 1 percent, respectively, assigning themselves a 
score of “very effective” in these areas. Somewhat further down were records and reporting, 
student supervision and managing attendance. The lowest mean effectiveness score for the items 
under this factor went to fulfilling special education requirements at 3.30. Just 40 percent of 
principals rated themselves “very effective” at these duties. 

External Relations 

The final dimension of principal task effectiveness we derived from the principals’ self-ratings 
concerns tasks related to working with stakeholders beyond the schoolhouse doors. Just four 
items load primarily on this factor: communicating with the district to obtain resources, working 
with local community members and organizations, utilizing district office communications to 
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enhance goals, and fundraising. A comparison of the External Relations factor with the previous 
four shows that the four tasks identified under this heading tend to have much lower mean 
effectiveness scores than nearly any other items assessed by the questionnaire. In fact, with the 
exception of two Instruction Management items, the mean scores of all four External Relations 
tasks are lower than the lowest- scored tasks from any other factor. Only 38 percent of principals 
rated themselves as “very effective” at either communicating with the district to obtain resources 
or working with the local community. Thirty-three percent said they were “very effective” at 
utilizing district communications. A low 18 percent expressed the highest level of confidence in 
their effectiveness at fundraising, with 26 percent describing themselves as “ineffective” or only 
“a little effective.” 

Having uncovered the five factors of principal task effectiveness discussed above, we 
applied a standard factor scoring method to the principals’ responses to assign an effectiveness 
score to each principal in each of the five task areas. Because the resulting scores are on an 
indeterminate scale, we standardized the scores to have a mean of zero and standard deviation of 
one. Each principal’s five individual scores then measure standard deviations of self-assessed 
effectiveness above or below that of the average principal. These standardized factor scores are 
the focus of our main analyses. 

DIFFERENCES IN TASK EFFECTIVENESS ACROSS SCHOOLS AND PRINCIPALS 

Principals may assess themselves as more or less effective on a given dimension of job tasks not 
only because of their own skills but also because of the difficulty of the contexts in which they 
work. There is growing evidence that school context influences principals’ practice (Stein and 
Nelson, 2003) and, consequently, their efficacy. For example, principals may have more 
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demands in challenging school contexts, and thus may need to focus their priorities on a 
narrower set of tasks (Goldring, Huff, May, and Cambum, 2008). Moreover, schools with certain 
characteristics may be able to attract principals who are more effective on one dimension than on 
another. For these reasons, we might expect to see systematic differences in these effectiveness 
measures between schools. Similarly, principals may become relatively more effective as they 
gain experience in the job, or they may differ based on their background characteristics. To 
assess these possibilities, we compare principals by gender, experience, and education. We also 
compare schools by school level (i.e. elementary, middle or high school), school enrollment, and 
proportion of students eligible for free or reduced price lunch, a measure of poverty. 

Table 2 shows that, on average, female principals rate themselves more highly on 
Instruction Management and Administration and less highly on Organization Management than 
do their male peers. More experienced principals rate themselves more highly on Instruction 
Management, Internal Relations, and Organization Management than their less experienced 
peers, but do not rate themselves differently on Administration or External Relations. Principals 
with higher educational attainment also rate themselves higher on most dimensions. In 
particular, principals' with doctoral degree rate themselves as stronger in Instruction 
Management, Organization Management and External Relations, while there is no difference by 
education level in Internal Relations or Administration. 

Table 2 also shows no important differences by school level, with principals in 
elementary, middle and high schools rating themselves approximately equally, on average. This 
result is somewhat surprising given that the organizational structures of high schools often differ 
from those of elementary schools in ways we might expect to emphasize the importance of 
different skill sets. We also find only minor differences in principals' self-reported effectiveness 
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by school enrollment, with principals in larger schools rating themselves higher on External 
Relations. 

Figure 2 illustrates differences in principals’ self-assessments by poverty level. We use 
free and reduced price lunch eligibility as a proxy for student disadvantage and categorize 
schools by quartile, comparing the 25 percent of schools with the highest concentrations of 
students in poverty with other schools in the district. Because of differences in poverty by school 
level, we separate elementary schools from middle and high schools for this analysis. The figure 
shows only small differences in average ratings by poverty level for elementary schools. None 
of the sample differences shown in the elementary school graph are statistically significant. At 
the high school level, however, principals in high-poverty schools are likely to feel more 
effective at Instruction Management and less effective at Organization Management than 
principals in other schools. These differences are quite large, totaling more than a quarter of a 
standard deviation for Instruction Management and more than half a standard deviation for 
Organization Management. 

Later we will argue that the stark differences in Organization Management effectiveness 
between principals in schools at opposite ends of the student disadvantage spectrum raises 
significant equity concerns, as we will discover that the Organization Management dimension of 
task effectiveness has stronger ties to positive school performance than do the other dimensions. 
However, differences among principals’ ratings may come either from the skills of the principals 
or from the difficulty of the job. If higher poverty schools are more difficult to manage than are 
other schools, principals may not feel as effective in these schools. Of course, all of the tasks 
may be more difficult in high poverty schools; the findings below indicate a differential 
difficultly or lack of effectiveness in Organization Management. 
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PRINCIPAL TASK EFFECTIVENESS AND MEASURES OF SCHOOL 
PERFORMANCE 



Ultimately we would like to know which skills are particularly beneficial for principals in order 
to improve the performance of their schools. There are multiple difficulties with identifying these 
skills using survey data and statistical techniques. The first is that our measures of skill may not 
be capturing what we would like them to capture. Self-assessments of effectiveness are clearly 
not the perfect measure of principal effectiveness. People do not always assess their own 
strengths accurately. Moreover, any single measure of school success is limited. Student test 
score performance, for example, may reflect school leadership skills but are also likely a 
reflection of the backgrounds of the students themselves. As a result, it is worth comparing 
principal’s assessment of their effectiveness to a range of other measures. In this section, we use 
three measures of school effectiveness, as discussed above: school grades in the Florida test- 
based school accountability system, teacher satisfaction, and parent grading of schools. 

The causal direction of the relationship between principals’ efficacy and school 
performance measures is not always clear. It is easy to imagine that principals feel better about 
their job performance in schools that are performing better. A simple correlation or partial 
correlation of principal efficacy and school performance would tell us little about the effects of 
principal skills on school outcomes. The analyses to follow address this causation concern in 
two ways, though neither approach is sufficient for identifying causality. First, we do not use an 
overall measure of principal efficacy but instead scores based on their sense of effectiveness on 
five dimensions that are uncorrelated with one another by design, a result of the varimax rotation 
procedure we used in the creation of the factors. A principal who is high on one dimension is no 
more or less likely to be high on any of the other dimensions. Thus, whereas we may be 
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concerned that a principal feels better about his skills overall when his school performs at a 
higher level, it is less obvious that these feelings would systematically be reflected among some 
skills rather than others. Second, we use a regression framework that adjusts for other 
characteristics of the school that, if omitted, might create biased estimates. All regressions 
account for school level, poverty and race. In addition, in the analyses estimating school grades 
in the Florida accountability system, we run specifications controlling for prior school grade so 
as to better estimate the relationship between principal task efficacy and performance gains. In 
the estimates of the other two measures, which are based on survey responses from teachers and 
parents, we run specifications controlling for school grade to separate the portion of these 
assessments attributable to the principal from the portion attributable to long-run school 
performance. 

Principals ’ Self-Assessed Task Effectiveness and State-Assessed School Effectiveness 
Figure 3 gives a first descriptive look at the relationship between principals’ assessment of their 
task effectiveness and school grades. The highest-performing schools, those assigned an A by the 
state accountability system, had principals who assessed themselves as more effective on all five 
of the dimensions. This difference is greatest for Organization Management and least strong for 
Instruction Management and External Relations. The associations between school performance 
and principal task efficacy depicted in Figure 3 may be causal, but it may also be the case that 
high performing schools differ in other ways that mask the true relationship between task 
effectiveness and performance. For example, if higher poverty schools have both lower 
Organization Management efficacy and lower performance, then the relationship between 
Organization Management and performance may just be a reflection of these poverty influences. 
To address this potential confounding of relationships, we look at the relation between task 
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efficacy and school performance in a multivariate framework that allows us to control for school 
characteristics. 3 

Table 3 shows the results of the analyses. Across all specifications, self-assessed 
effectiveness in Organization Management is positively related to school performance. In most 
specifications this relationship is statistically significant, and in those where it is not, the p-values 
fall just above the 0.10 cutoff. No other task-efficacy dimension is statistically associated with 
school performance. As an example of the relationship between Organization Management and 
performance, in column 1, we see that for all schools, a standard deviation increase in 
Organization Management is associated with a 0.12-point increase in school accountability 
performance, which is an increase of approximately ten percent of a standard deviation. 

The remaining columns include controls for prior school grades and, in this way, estimate 
the relationship between the task dimensions and performance gains, rather than just 
performance levels. Our preferred control is the 2005 grades because it balances the advantage 
of assessing longer term gains with the disadvantage of potentially attributing changes to 
principals that they were not responsible for (column 3), though for completeness we include in 
columns 2 and 4 other prior years’ grades as controls as well. The point estimate for 
Organization Management in column 3 is 0.09, corresponding to a standardized beta value 
(effect size) of 0.08. For comparison, the effect sizes for percent black and percent subsidized 
lunch are -0.34 and -0.17, respectively, suggesting that the association between outcomes and 



3 We also considered the possibility that principal characteristics, such as experience and education, should be 
included in our models. In an alternative set of models, we included these variables in all of the principal 
effectiveness regressions and found that neither experience nor education significantly explained any of 
dependent variables after the effectiveness factors were included. In none of the models could we reject the null 
hypothesis in a joint F-test that the variables all equaled zero. Moreover, the point estimates for the principal 
effectiveness variables were robust to the inclusion of these variables. As a result, in the interest of model 
parsimony we chose not to include principal characteristics in the models we report. 
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Organization Management is between one-fourth and one-half as large as the association 
between outcomes and student demographics. 4 

Next we split the sample between elementary schools and middle and high schools to 
examine whether the effectiveness associations are driven by school level (columns 5 and 6). 
However, we find only small differences. While the Instruction Management coefficient is larger 
for secondary schools and statistically significant at the 0.10-level, the other effectiveness 
variables remain similar. The point estimates for Organization Management are identical in both 
models ifi = 0.10), though due to the smaller number of upper-level schools, the coefficient is 
only statistically significant for elementary schools. 

Teacher Satisfaction 

The first two columns of Table 4 give the result of a similar estimation using teacher satisfaction 
as the outcome variable. The impact of principal skills on teachers is an important consideration 
both because the teacher is a central stakeholder in schools and because teacher satisfaction and 
turnover have been linked to lower student performance (Judge et al., 2001; Ostroff, 1992; 
Rivkin, Hanushek, and Kain, 2005). The regressions are performed at the teacher level but 
clustered at the school level to account for the hierarchical nature of the data. The two models 
shown are identical, controlling for school and teacher characteristics, except that the second 
column adds a control for the school’s state accountability grade for 2007. Adding this control 
removes that part of teacher satisfaction associated with working in a traditionally high- 
performing school. 



4 A comparison of the R 2 coefficient in column 3 to one for an equivalent model without the five task effectiveness 
variables shows that the principal variables explain 6-7% of the remaining variation in accountability grades after 
accounting for school characteristics. 
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In both models, again, Organization Management is positive, with coefficients ranging 
from 0.027 to 0.015, though the coefficient is only significantly different than zero in the first 
column, before controlling for last year’s accountability grade. The effect size in column 2 is 
0.02, compared to 0.15 for the 2007 grade and -0.11 for percent black. The decline in the 
coefficient between the two models suggests that a significant portion of Organization 
Management’s effects on teacher satisfaction may operate indirectly via its effects on student 
performance. Perhaps surprisingly, principal task efficacy in Administration is negatively and 
significantly related to teacher satisfaction in both models (effect size = -0.03), suggesting that 
principals whose skills are strongest in routine administrative tasks are least equipped to create 
positive teacher work environments. Instruction Management is not associated with teacher 
satisfaction in either model. In general, the low degree of power the principal effectiveness and 
other variables have in explaining teacher satisfaction may result from the relative roughness and 
low variation of the available satisfaction measure. 

Parents ’ Ratings of School Performance 

The final two columns of Table 4 model parents’ assessments of the school from the school 
climate survey as a function of principal efficacy in the five task dimensions, controlling for 
school characteristics. We see that parents rate schools more highly when there is a lower 
concentration of black students or students eligible for subsidized lunch, when the school is 
smaller, when it is an elementary school relative to a high school or a high school relative to a 
middle school, and when the schools’ state accountability grade is higher. 

More importantly for this study, we find again a positive association between principals’ 
self-assessed Organization Management skills and parents’ assessments of the schools’ 
performance in both models. This partial correlation is statistically significant at the 0.01-level, 
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both with and without the control for school performance, though the smaller coefficient on 
Organization Management in the second model (/? = 0.14, effect size = 0.08) indicates that some 
of the relationship between this dimension and the parents’ assessment can be attributed to the 
tendency for principals with better Organization Management skills to be located in schools with 
higher-performing students. Some of this difference may result from the indirect effect that 
principal Organization Management has on student outcomes, as suggested in Table 3. None of 
the other areas of task efficacy are statistically associated with parent rating in either model, 
suggesting that, at the margins, effective Organization Management skills are a more important 
determinant of parents’ views of their children’s schools than other principal skill groups. 5 

FURTHER EVIDENCE ON PRINCIPAL TASK EFFECTIVENESS FROM ASSISTANT 
PRINCIPAL ASSESSMENTS 

The analyses thus far have been based on principals’ assessments of their own task effectiveness. 
We have seen that the principals in our sample distinguish five areas of effectiveness and that 
their efficacy at Organization Management tasks is most consistently associated with positive 
school outcomes. However, the usefulness of these results may be limited by the fact that they 
are based on principals’ self-assessments, which are not an ideal measure of the principals’ true 
effectiveness at these tasks. While the principals’ self-ratings have an informational advantage in 
the sense that principals experience themselves performing all of the tasks, they are not unbiased 
observers and thus may not provide objective assessments. One means of evaluating the validity 
of the principals’ self-assessments is to check them against the ratings of another observer. This 
technique is commonly employed in the development of personality tests and leadership 

5 M-DCPS also provided us with students' climate ratings, which were obtained in a survey similar to the one given 
to parents. The student grades were highly correlated with parents' (r = 0.84); thus, the results obtained from 
using the student evaluations qualitatively were very similar to the parent results. For sake of brevity, these results 
are omitted. 
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inventories (Leslie and Fleenor, 1998). To provide this external check, we use assistant 
principals’ evaluations of their supervising principals’ skill sets. 

Using assistant principals’ ratings has advantages and disadvantages. Assistant principals 
observe their principals performing many but not all of the tasks, which makes them more 
qualified to judge principals’ competencies in some areas than in others. For example, the 
assistant principal may have a good sense of how well the principal works at maintaining campus 
facilities but not of how well the principal networks outside the school. Also, like principals, 
assistant principals are unlikely to be unbiased observers of their principal’s performance, though 
given that these biases need not run in the same direction as the principals’, finding similarities 
between the two sets of ratings would be good confirmation that the dual evaluations provide 
meaningful information about the principals’ skills. 

The approach that we take to the analysis of the assistant principals’ ratings is similar to 
that used for the principals’ ratings. We administered a survey to all assistant principals in the 
district to collect assessments of the principals’ effectiveness on the same set of 42 tasks given to 
the principals. Exploratory factor analysis of these responses with varimax rotation identified 
groupings that we use to define the dimensions of assistant principal-assessed principal 
effectiveness. 6 

Using the minimum eigenvalue criterion, assistant principals’ distinguish three areas of 
principals’ task effectiveness: Instruction Management , Internal Relations , and Organization 
Management. The factor loadings for this analysis are given in Appendix 2. These three factors 
generally are consistent with the first three factors identified by the principals. In contrast to the 
principals’ ratings, the assistant principals did not distinguish Organization Management from 

6 Two survey items. Teaching students and Planning professional development for prospective principals, were 
dropped from the assistant principal analysis because they contained more than 10% "I don't know" or other 
missing responses. A small number of values were imputed to avoid loss of sample size due to item non-response. 
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more routine administrative tasks, nor did they identify a separate External Relations dimension, 
perhaps because they do not commonly observe principals performing these tasks. Examination 
of the factor loadings matrix reveals less stringent differentiation of principal skills by the 
assistant principals in general. Compared to the matrix in Appendix 1, assistant principal items 
are more likely to load highly on at least two factors. In fact, five items, grouped together at the 
bottom of the table, load relatively highly on all three factors, suggesting that, from the 
perspective of the assistant principals, these tasks necessitate competency across all three 
dimensions. A good example is efficacy at hiring personnel, which correlates with management 
of instruction and of the organization more generally, as well with principals’ interpersonal 
skills. 

The correlations between the principals' and the assistant principals' ratings are not high, 
probably as a result both of the different perspectives on performance captured and of imprecise 
measurement. Imprecision of measurement is a characteristic of the factor model by design, 
given its basis in the idea that each variable in the analysis is a noisy measure of one or more 
constructs that are not directly observable. The error associated with the measures of both the 
principal and assistant principal factors will attenuate the correlations between them. 
Nonetheless, examining these correlations for patterns is useful. The assistant principals' 
assessment of the principals' effectiveness at Instruction Management and Internal Relations are 
positively correlated with the principals’ self-assessments on these dimensions, but these 
correlations are both below 0.10 and not statistically significant. The assistant principals' 
assessment of the principals' effectiveness at Organization Management is positively and 
significantly correlated with the principal measure of effectiveness at Organization Management 
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(r=0.15), though also negatively correlated with the principals' assessment of their own 
effectiveness at External Relations (r=-0.11). No other correlations are statistically significant. 

Next we model the relationship between assistant principals’ factored assessment of their 
principals’ effectiveness and the same three school outcomes used before: school accountability 
grades, teacher satisfaction and parents’ rating of the school. Assistant principal factors are 
averaged at the school level and standardized across schools. Table 5 gives the results. Here 
again, Organization Management skills emerge as consistently positive and statistically different 
from zero across specifications. Controlling for school characteristics, Organization 
Management, as rated by the assistant principals, is positively and statistically significantly 
related to accountability performance level, teacher satisfaction and parent climate survey 
assessments of school performance. These findings bolster our argument that principals’ general 
managerial skills are important contributors to school success. 

In contrast, neither of the other dimensions of principals skills is consistently associated 
with school performance, nor are the point estimates as large. Internal Relations skills are 
positively associated with teacher satisfaction in both models, but only significantly associated 
with parent climate grades before past performance is included. Moreover, Internal Relations do 
not predict student performance. As before, the skills associated with Instruction Management 
have no predictive power in any specification; in fact, the point estimates for this variable are 
negative in four of the six models. 

DISCUSSION AND CONCLUSION 

This paper makes two contributions to the existing literature on principals' work and principals' 
effectiveness. First, it uses principals' own assessment of their efficacy on a set of 42 tasks 



30 




common to principal job to distinguish five dimensions of principal task-effectiveness. We do 
not pre-define these dimensions but instead use correlations across principals' responses to 
uncover their own delineation of these dimensions. The areas of task effectiveness that emerge 
from this process are: Instruction Management , Internal Relations, Organization Management, 
Administration , and External Relations. Across the board, principals feel effective at the work 
they do, but there are systematic differences, particularly with an overall lower sense of 
effectiveness in External Relations than in the other areas. 

The remainder of the paper assesses the relationship between task-efficacy and school 
outcomes. The analyses emphasize the importance of principal Organization Management skills 
for predicting school outcomes. Across measures derived from multiple constituents — students, 
teachers and parents — and on multiple dimensions, the principals’ effectiveness on organization 
management tasks consistently predict greater school performance. When we triangulate the 
principal’s assessment with those of the assistant principals in his or her school, we find similar 
results, confirming the central role that Organization Management effectiveness plays in 
successful schools. In contrast, we find few positive relationships between school outcomes and 
the other four dimensions of task effectiveness we identify. In fact, for some outcome measures, 
we find statistically significant negative associations for some factors, such as the negative 
correlation between Administrative efficacy and teacher satisfaction. 

While we do not find positive associations between school outcomes and efficacy in 
instruction management, our findings are not necessarily inconsistent with research advocating 
the importance of instructional leadership for principals. However, they are inconsistent with the 
view that increasing the principal’s focus narrowly on overseeing instruction and observing 
teachers in classrooms at the expense of managing key organizational functions, such as 
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budgeting and maintaining campus facilities, is likely to result in school success. This view is 
corroborated by Hallinger (2005), who notes in his review of the instructional leadership 
literature that despite popular images of instructional leaders directly supervising and evaluating 
teachers, very few studies find instructional leaders displaying hand-on supervision of classroom 
instruction. Rather, effective instructional leadership combines an understanding of the 
instructional needs of the school with an ability to target resources where they are needed, hire 
the best available teachers, provide teachers with the opportunities they need to improve, and 
keep the school running smoothly. Our analyses suggest that, at the margins, principal efficacy in 
these latter functions is more important for school effectiveness than previous work has 
emphasized (e.g., Heck, 1992; Leithwood, 1994). In contrast to Robinson, Lloyd, and Rowe 
(2008), who assert that “the closer educational leaders get to the core business of teaching and 
learning, the more likely they are to have a positive impact on students’ outcomes” (664), we 
conclude that principals devoting significant time and energy to becoming instructional leaders 
in their schools are unlikely to see improvement unless they increase their capacity for 
Organization Management as well. 

These results argue for a broader definition of instructional leadership that includes skills 
embodied by our Organization Management dimension. Before the focus of the instructional 
leadership literature became direct interaction with teachers, Murphy (1988) argued as much, 
cautioning against adopting a false dichotomy between management and instructional leadership, 
as “this perspective incorrectly separates two potentially reinforcing constructs and overlooks the 
ways in which traditional, routine actions (i.e., management behaviors) can contribute to 
improved teaching and learning” (127). Recalling Marks and Printy’s (2003) call for integrating 
leadership perspectives, we suggest that a more holistic view of school leadership as 
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necessitating skills across multiple dimensions, but especially as related to being the managers of 
the school as an organization, is important for identifying the ways that principals can promote 
school improvement. 

Our findings have direct policy implications. First, districts seeking to identify the best 
candidates for open principal positions in their districts or to recruit potential candidates into the 
district’s principal pipeline may benefit by considering candidates’ Organization Management 
competencies, such as those needed for effective teacher hiring and budget allocation. Almost all 
principals have substantial teaching experience prior to becoming an administrator, and this 
experience is likely to serve them well. However, many principals have few experiences 
managing complex organizations prior to entering administration in their school. As a result, it 
may be these skills, on average, that principals lack. It may well be that a productive strategy for 
increasing the performance of the districts’ lowest-achieving schools would be to shift the 
principals with the greatest management skills to those schools. 

Unfortunately, in the district participating in the present study, we see little evidence of 
such a strategy. As we observe in Figure 2, the schools with the highest levels of student poverty, 
particularly at the middle and high school levels, tended to be led by principals assessing 
themselves the lowest on the Organizational Management dimension. Instead, the district has 
hired principals into these schools who systematically are higher on the Instruction Management 
dimension, a human resource decision we have noted is supported by earlier research but that 
shows no evidence here of improving school performance. Given their strong relationship with 
school performance in this study, a strategy of allocating principals with stronger Organization 
Management skills may be one vehicle for promoting intra-district equity. 
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A second important implication is for the investments that states and districts should 
make in principal preparation. In particular, pre-service and in-service administrator professional 
development programs may promote the greatest gains in overall principal effectiveness by 
focusing on the development of management competencies. Results of prior work on principal 
development programs are consistent with this recommendation. For example, Levine (2005) 
studies the content of top educational administration programs and concludes that even the best 
programs tend to be overly theoretical and disconnected from the needs of day-to-day school 
management. Similarly, in a study of 210 syllabi from educational leadership programs 
nationwide, Hess and Kelly (2007) conclude that pre-service training is deficient in such key 
management topics as handling personnel and maintaining facilities. We suggest that cultivating 
a focus on development of Organization Management skills among school leaders should be 
considered as one avenue for school improvement that might be pursued. 

The study we have described faces several important limitations. The first is its limited 
geographic scope. While working with data from one large district holds many advantages, M- 
DCPS is atypical in several respects, making external validity a concern. M-DCPS educates an 
uncommonly diverse student body. Its large size (roughly 350,000 students) makes its leadership 
structure more hierarchical than most. At the time of our data collection, the district’s 
superintendent, Rudy Crew, was completing implementation of a strategic plan emphasizing 
instruction, professional development and school and district leadership that resulted in the 
district being named a finalist for the prestigious Broad Prize in Urban Education (for the most 
improved urban school district in the nation) three years in a row. Thus, until further work is 
done, we are not able to say how well our results generalize to other districts with different 
organizational structures, student bodies and cultures. This limitation is potentially a significant 
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one given the argument in other studies that the deployment of leadership skills and knowledge 
depends on context (Coburn, Toure, and Yamashita, 2009; Stein and Nelson, 2003). Expanding 
the analysis to other schools and districts also would allow for further testing and revision of the 
task effectiveness inventory on which this study’s results are based, which may provide school 
districts with a useful new tool for evaluating prospective and continuing principals. 

A second limitation is the cross-sectional nature of the study, which prevents us from 
being able to examine how school outcomes may change when principals with different skill sets 
move into the school over time. This limitation also prevents us from doing a full analysis of 
how principal skills change and develop as they gain experience and adapt and respond to the 
particular school environments in which they work. Developing longitudinal data sets that allow 
for these two areas of study would be a fruitful direction for future research. 
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FIGURES 



Figure 1: Principals' Ratings of Own Task Effectiveness Grouped by Factors 
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Figure 2: Principals' Task Effectiveness by School Poverty 
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Figure 3: Principals' Task Effectiveness by School Accountability Grade 
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TABLES 



Table 1: Descriptive Statistics 



Variable 


N 


Mean 


SD 


Min 


Max 


School Characteristics 


Percent black students 


244 


32.87 


34.01 


0 


96.91 


Percent free/reduced lunch students 


244 


67.99 


21.98 


9.61 


98.3 


School size (in 100s) 


244 


11.92 


8.75 


0.7 


45.09 


Elementary school 


244 


0.60 


0.49 


0 


1 


Middle school 


244 


0.20 


0.4 


0 


1 


High school 


244 


0.15 


0.36 


0 


1 


Combination (K-12) school 


244 


0.05 


0.23 


0 


1 


School accountability grade (2007-08) 


244 


3.92 


1.19 


1 


5 


School grade from parent survey (2007-08) 


248 


5.62 


1.57 


1 


8 


Principal Characteristics 


Female 


249 


0.69 




0 


1 


Black 


249 


0.33 




0 


1 


Hispanic 


249 


0.61 




0 


1 


Number of years in current job 


249 


3.08 


3.46 


0 


17 


Age 


249 


50.08 


8.32 


32 


67 


Holds Master's degree or higher 


249 


0.49 




0 


1 


Teacher Characteristics 


Female 


9651 


0.78 


0.41 


0 


1 


Black 


9651 


0.25 


0.44 


0 


1 


Hispanic 


9651 


0.54 


0.5 


0 


1 


Number of years in current job 


9651 


5.41 


5.93 


0 


48 


Age 


9651 


43 


11.75 


18 


79 


Holds Master's degree or higher 


9651 


0.36 


0.48 


0 


1 


Teacher Satisfaction 


9651 


3.43 


0.80 


1 


4 
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Table 2: Comparing Principals' Ratings of Own Effectiveness across Selected Characteristics of 
Principals and Schools 





Instruction 

Management 


Internal 

Relations 


Organization 

Management 


Administration 


External 

Relations 


Principal Gender 


Male 


-0.25 


-0.02 


0.19 


-0.21 


-0.02 


Female 


Q ^2*** 


0.01 


-0.08** 


0.09** 


0.026 


Principal Experience 


0-1 years 


-0.13 


-0.17 


-0.26 


-0.01 


-0.11 


2-4 years 


0.04 


0.12** 


q 


-0.05 


0.16** 


5+ years 


0.22** 


0.18** 


0.29*** 


0.07 


0.05 


Principal Highest Degree 


Bachelor's degree 


-0.21 


0.05 


-0.24 


-0.05 


-0.29 


Master's degree 


0.04 


0.06 


0.03* 


0.04 


-0.02* 


Education Specialist 


-0.58 


0.14 


0.36** 


-0.14 


0.47*** 


Doctorate 


0.37*** 


-0.20 


0.13** 


-0.01 


0.38*** 


Other 


-0.45 


-0.07 


-0.12 


-0.02 


-0.39 


School Type 


Elementary 


0.01 


0.08 


0.05 


0.06 


-0.04 


Middle 


0.03 


-0.14 


-0.09 


-0.04 


0.13 


High 


-0.11 


-0.12 


-0.01 


-0.16 


0.07 


School Size (by quartile) 


0-593 


0.07 


0.08 


-0.05 


-0.01 


-0.13 


594-881 


0.05 


-0.05 


-0.13 


-0.02 


-0.22 


882-1266 


0.12 


0.13 


0.07 


0.15 


0.07 


1267-4509 


-0.19 


-0.06 


0.07 


-0.09 


0.23* 


Asterisks indicate significant differences from first category within groupings. * 


p<0.10, ** p<0.05, 


*** p<0.01. 
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Table 3: Principal Task Effectiveness and School Accountability Performance 



Levels 






Gains 
















Middle and 


All schools 




All schools 




Elementary 


high 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 



Instruction 

Management 


0.019 


0.034 


0.036 


0.018 


0.003 


0.117* 




(0.048) 


(0.043) 


(0.042) 


(0.048) 


(0.064) 


(0.066) 


Internal Relations 


-0.008 


0.003 


-0.005 


-0.005 


0.015 


0.057 




(0.049) 


(0.044) 


(0.043) 


(0.049) 


(0.060) 


(0.070) 


Organization 

Management 


0 . 121 ** 


0.070 


0.093** 


0.137*** 


0 . 102 * 


0.102 




(0.050) 


(0.046) 


(0.045) 


(0.050) 


(0.061) 


(0.076) 


Administration 


0.063 


0.059 


0.059 


0.063 


0.026 


0.056 




(0.047) 


(0.042) 


(0.042) 


(0.047) 


(0.066) 


(0.059) 


External Relations 


0.003 


-0.015 


0.022 


-0.003 


0.067 


0.016 




(0.049) 


(0.045) 


(0.044) 


(0.049) 


(0.071) 


(0.060) 


% black students 


-0.015*** 


- 0 . 011 *** 


- 0 . 012 *** 


-0.014*** 


- 0 . 012 *** 


- 0 . 012 *** 




( 0 . 002 ) 


( 0 . 002 ) 


( 0 . 002 ) 


( 0 . 002 ) 


( 0 . 002 ) 


(0.003) 


% subsidized lunch 


- 0 . 020 *** 


-0.009*** 


-0.009*** 


-0.015*** 


- 0 . 010 *** 


0.003 




(0.003) 


(0.003) 


(0.003) 


(0.004) 


(0.004) 


(0.006) 


School size (in 100s) 


- 0.000 


0.004 


-0.009 


- 0.010 


0.010 


-0.025*** 




( 0 . 010 ) 


(0.009) 


(0.009) 


( 0 . 010 ) 


( 0 . 022 ) 


(0.009) 


Elementary school 


1.627*** 


0 797 *** 


0.662** 


1 309*** 








(0.249) 


(0.255) 


(0.255) 


(0.271) 






Middle school 


1 390*** 


0.875*** 


0.823*** 


1.096*** 








(0.226) 


( 0 . 221 ) 


(0.219) 


(0.247) 






Combination (K-12) 


1 390*** 


0 779 *** 


0 . 686 ** 


1.302*** 








(0.293) 


(0.280) 


(0.277) 


(0.318) 






School grade, 2007 




0.383*** 














(0.052) 










School grade, 2005 






0.409*** 




0.296*** 


0.770*** 








(0.052) 




(0.068) 


( 0 . 102 ) 


School grade, 1999 








0.179** 














(0.089) 






Constant 


4.457*** 


2.770*** 


2.841*** 


4.008*** 


3.890*** 


1.720** 




(0.327) 


(0.409) 


(0.388) 


(0.515) 


(0.481) 


(0.779) 


Observations 


244 


241 


242 


234 


147 


82 


Adjusted R-squared 


0.616 


0.684 


0.693 


0.626 


0.569 


0.790 


Standard errors in parentheses. * p<0.10, 


** p<0 05 *** 


p< 0 . 01 . 
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Table 4: Principal Task Effectiveness, Teacher Satisfaction and Parent Climate Survey Grades 



Dependent Variable 


Teacher satisfaction 


Parent climate grades 


(1) 


(2) 


(1) 


(2) 


Instruction Management 


-0.012 


-0.011 


-0.073 


-0.025 




(0.012) 


(0.013) 


(0.060) 


(0.048) 


Internal Relations 


0.023 


0.022 


0.036 


0.027 




(0.016) 


(0.015) 


(0.056) 


(0.048) 


Organization Management 


0.027* 


0.015 


0.249*** 


0.136** 




(0.015) 


(0.014) 


(0.059) 


(0.053) 


Administration 


-0.019* 


-0.021* 


0.059 


0.071 




(0.011) 


(0.011) 


(0.053) 


(0.043) 


External Relations 


-0.009 


-0.011 


0.082 


0.041 




(0.012) 


(0.012) 


(0.055) 


(0.042) 


Percent black students 


-0.004*** 


-0.003*** 


-0.016*** 


-0.008*** 




(0.001) 


(0.001) 


(0.002) 


(0.002) 


Percent free/reduced lunch students 


-0.004*** 


-0.001 


-0.025*** 


-0.007** 




(0.001) 


(0.001) 


(0.003) 


(0.003) 


School size (in 100s) 


-0.002 


-0.003 


-0.061*** 


-0.043*** 




(0.003) 


(0.002) 


(0.013) 


(0.012) 


Elementary school 


0.123 


-0.105 


1 47g*** 


0.360 




(0.079) 


(0.070) 


(0.342) 


(0.345) 


Middle school 


0.004 


-0.161*** 


0.034 


-0.617** 




(0.073) 


(0.062) 


(0.312) 


(0.293) 


Combination (K-12) school 


0.117 


-0.064 


0.996*** 


0.265 




(0.074) 


(0.068) 


(0.364) 


(0.339) 


School grade, 2007 




0.088*** 




0.647*** 






(0.017) 




(0.062) 


Female teacher 


0.016 


0.017 








(0.025) 


(0.025) 






Black teacher 


0.107*** 


0 in*** 








(0.025) 


(0.025) 






Hispanic teacher 


-0.120*** 


-0.118*** 








(0.021) 


(0.021) 






Teacher's years in current job 


0.002 


0.001 








(0.002) 


(0.002) 






Teacher's age 


0.006*** 


0.006*** 








(0.001) 


(0.001) 






Teacher holds Master's degree 


-0.021 


-0.027 








(0.017) 


(0.017) 






Constant 


3.539*** 


3 191*** 


7.585*** 


4.429*** 




(0.109) 


(0.125) 


(0.505) 


(0.485) 


Observations 


9838 


9612 


248 


240 


Adjusted R-squared 


0.059 


0.067 


0.688 


0.803 


Standard errors in parentheses. * p<0.10, ** p<0.05, *** 


p<0.01. 
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Table 5: Assistant Principals' Assessments of Principal Task Effectiveness and Multiple Measures of School Outcomes 





Dependent Variable: Accountability grade 


Teacher satisfaction 


Parent climate grades 




(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


Instruction Management 


-0.020 


-0.009 


0.014 


0.010 


-0.030 


-0.055 




(0.048) 


(0.047) 


(0.018) 


(0.018) 


(0.053) 


(0.052) 


Internal Relations 


0.070 


0.005 


0.036** 


0.028* 


0.143** 


0.031 




(0.049) 


(0.045) 


(0.015) 


(0.016) 


(0.061) 


(0.053) 


Organization Management 


0.089* 


0.103** 


0.045*** 


0.034** 


0.089* 


0.070* 




(0.046) 


(0.048) 


(0.016) 


(0.015) 


(0.049) 


(0.043) 


Percent black students 


-0.017*** 


-0.013*** 


-0.003*** 


-0.003*** 


-0.017*** 


-0.008*** 




(0.002) 


(0.002) 


(0.001) 


(0.001) 


(0.002) 


(0.002) 


Percent free/reduced lunch students 


-0.018*** 


-0.008*** 


-0.003*** 


-0.001 


-0.021*** 


-0.006** 




(0.002) 


(0.002) 


(0.001) 


(0.001) 


(0.003) 


(0.003) 


School size (in 100s) 


-0.011 


-0.012* 


-0.002 


-0.001 


-0.062*** 


-0.036*** 




(0.010) 


(0.007) 


(0.002) 


(0.002) 


(0.010) 


(0.012) 


Elementary school 


1 279*** 


0.399** 


0.105* 


-0.040 


1.446*** 


0.544 




(0.267) 


(0.197) 


(0.056) 


(0.072) 


(0.269) 


(0.336) 


Middle school 


1 029*** 


0.567*** 


-0.006 


-0.113* 


0.073 


-0.417 




(0.250) 


(0.181) 


(0.056) 


(0.061) 


(0.267) 


(0.293) 


Combination (K-12) school 


0.052 


0.159 


0.072 


0.026 


0.689 


0.590 




(0.316) 


(0.333) 


(0.069) 


(0.083) 


(0.460) 


(0.631) 


School grade, 2005 




0.485*** 














(0.058) 










School grade, 2007 








0.071*** 




0.653*** 










(0.019) 




(0.069) 


Constant 


4.824*** 


2 712*** 


3.462*** 


3 152*** 


7.444*** 


4.095*** 




(0.372) 


(0.370) 


(0.087) 


(0.128) 


(0.381) 


(0.502) 


Observations 


241 


239 


10173 


9712 


251 


238 


Adjusted R-squared 


0.613 


0.711 


0.052 


0.058 


0.644 


0.773 



Standard errors in parentheses. * p<0.10, ** p<0.05, *** p<0.01. Models 3 and 4 also include controls for teacher characteristics (female, black, Hispanic, years in job, age, 
MA degree). 
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APPENDIX I 



Factor Loadings Matrix for Principal Effectiveness Factors 



Instruction 


Internal 


Organization 




External 


Management 


Relations 


Management 


Admin. 


Relations 


Eigenvalues 12.6 


1.9 


1.5 


1.2 


1.0 



Using data to inform instruction 0.53 

Developing a coherent educational program across the school 0.58 

Using assessment results for program evaluation 0.62 

Formally evaluating teachers & providing instructional feedback 0.61 

Classroom observations 0.53 

Utilizing school meetings to enhance school goals 0.37 

Planning professional development for teachers 0.72 

Implementing professional development 0.67 

Evaluating curriculum 0.62 

Informally coaching teachers 0.62 

Directing supplementary, after-school or summer instruction 0.47 

Releasing/counseling out teachers 0.53 

Planning professional development for prospective principals 0.52 



0.35 



0.36 



0.36 



0.45 



Developing relationships with students 

Communicating with parents 

Attending school activities (e.g. sports events) 

Counseling students or parents 

Counseling staff about conflicts with other staff members 
Informally talking to teachers about students 
Interacting socially with staff 



0.60 

0.63 

0.46 

0.66 

0.67 

0.45 0.55 

0.50 



Developing a safe school environment 
Dealing with concerns from staff 
Managing budgets & resources 
Hiring personnel 

Managing personal, school-related schedule 
Maintaining campus facilities 
Managing non-instructional staff 
Interacting/networking with other principals 



0.36 

0.40 



0.39 



0.55 

0.50 

0.59 

0.51 

0.53 

0.65 

0.51 

0.27 



Managing school schedules 

Managing student discipline 

Fulfilling compliance requirements & paperwork 

Implementing standardized tests 

Managing student services (e.g. records, reporting) 

Supervising students (e.g. lunch duty) 

Managing student attendance-related activities 
Fulfilling special education requirements 



0.38 



0.37 

0.38 

0.40 



0.38 

0.38 

0.40 

0.61 

0.60 

0.45 

0.49 

0.49 



Communicating with the district to obtain resources 0.47 

Working with local community members/organizations 0.40 

Utilizing district office communications to enhance goals 0.47 

Fundraising 0.40 



Varimax rotation employed. Loadings lower than 0.35 not shown. 
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APPENDIX II 



Factor Loadings Matrix for Assistant Principal Effectiveness Factors 





Instruction 

Management 


Internal 

Relations 


Organization 

Management 


Eigenvalues 26.5 


1.5 


1.2 


Using assessment results for program evaluation 


0.8071 






Planning professional development for teachers 


0.8042 






Evaluating curriculum 


0.7996 






Using data to inform instruction 


0.7863 






Implementing professional development 


0.7646 






Developing a coherent educational program across the school 


0.7402 


0.4237 




Directing supplementary, after-school or summer instruction 


0.6851 






Fulfilling special education requirements 


0.6686 






Informally coaching teachers 


0.6584 


0.5428 




Formally evaluating teachers & providing instructional feedback 


0.6174 


0.6088 




Classroom observations 


0.6033 


0.5293 




Implementing standardized tests 


0.5937 




0.5215 


Releasing/counseling out teachers 


0.5448 


0.4507 




Fundraising 


0.5032 


0.454 




Communicating with parents 




0.7695 




Developing relationships with students 




0.7406 




Counseling staff about conflicts with other staff members 


0.4306 


0.7373 




Interacting socially with staff 




0.7303 




Dealing with concerns from staff 




0.7035 


0.4145 


Managing non-instructional staff 




0.684 


0.4177 


Informally talking to teachers about students 


0.4474 


0.6704 




Attending school activities (e.g. sports events) 


0.4161 


0.6692 




Counseling students or parents 


0.4853 


0.6642 




Working with local community members/organizations 


0.4362 


0.5875 




Managing school schedules 


0.5654 




0.6809 


Developing a safe school environment 




0.4222 


0.6768 


Maintaining campus facilities 




0.4321 


0.6503 


Fulfilling compliance requirements & paperwork 


0.582 




0.6439 


Managing student services (e.g. records, reporting) 


0.5164 




0.6075 


Managing personal, school-related schedule 


0.4631 




0.5945 


Managing student discipline 




0.5661 


0.5807 


Supervising students (e.g. lunch duty) 




0.456 


0.5631 


Managing student attendance-related activities 


0.5136 




0.5613 


Interacting/networking with other principals 




0.5132 


0.5175 


Managing budgets & resources 






0.5027 


Hiring personnel 


0.4254 


0.5222 


0.4408 


Utilizing district office communications to enhance goals 


0.5247 


0.4612 


0.4999 


Communicating with the district to obtain resources 


0.4855 


0.4705 


0.4093 


Engaging in self-improvement 


0.5691 


0.4674 


0.4302 


Utilizing school meetings to enhance school goals 


0.5329 


0.5335 


0.4214 


Varimax rotation employed. Loadings lower than 0.40 not shown. 
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